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DUALITY  IN  SEMI- INFINITE  PROGRAMS 
AND  SOME  WORKS  OF  HAAR  AND  CARATHEODORY 

by 

A.  Charnes.  W.  W.  Cooper  and  K.  Kortanck*^ 


Foreword 

The  following  paper  was  stimulated  by  a  paper  of  the  Hungarian  mathe¬ 
matician,  A.  Haar  (possibly  one  of  the  all-time  great  mathematicians). 
Because  it  was  published  in  a  relatively  obscure  journal,  it  has  only  recently 
been  made  generally  available  through  tlte  posthumous  publication  of  his 
collected  works.  Since  the  theorems  to  be  established  rest  heavily  on  this 
work,  and  Haar's  paper  is  published  in  German,  we  present  it  for  ease  of 
access  in  free  translation  in  the  appendix. 

Introduction 

Conjectured  by  vonNcumann  anti  proved  by  Gale,  Kuhn  and  Tucker  [l], 
the  dual  theorem  of  linear  programming  has  been  unique  among  dual  extremal 
(or  variational)  principles  (sec,  for  example,  K.  Friedrichs  [z]  for  classical 
mathematical  physics  principles,  and  J.  Dennis  [3j  and  V/.  S.  Dorn  [4]  for 
more  recent  use  of  Legendre  transformations  to  establish  dual  "quadratic" 
programming  principles)  applying  to  general  systems  of  constraints  involving 
a  finite  number  of  variables  in  that  neither  principle  contains  the  variables 
associated  with  the  other.  The  theorem  has  also  been  sho\vn  to  be  as  funda¬ 
mental  for  the  theory  of  linear  inequalities  (see  particularly  Charnes  and 
Cooper  [  5]  for  this  approach)  as  the  classic  Farkas-Minkowski  lemma. 


The  research  of  A.  Charnes  and  K.  Kortanck  at  Northwestern  University 
has  been  supported  by  O,  N.  R,  contract  Nonr-1228(10);  tltat  of  W.  W.  Cooper 
at  Carnegie  Institute  of  Technology  has  been  supported  by  O,  N.  R.  contract 
Nonr-760(01),  Reproduction  in  v/holc  or  in  part  is  permitted  for  any  purpose 
of  the  United  States  Government. 
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Generalizations  to  linear  mappings  between  linear  topological  spaces 
were  forthcoming  from  S.  Karlin  and  H.  F.  Dohncnblust  [6]  (also  L.  Hurwicz 
[7])  for  the  Farkas-Minkowski  lemmat  and  from  D.  Bratton  (also  recently 
K.  Kretschmer  [8])  for  the  dual  theorem  in  a  brilliant,  unpublished  but  well- 
known  paper  [9].  As  expected,  these  generalizations  are  not  nearly  as 
strong  or  precise  as  the  original  finite  dimensional  theorems. 

The  Farlcas-Minkowski  lemma  has  been  extended  in  another  direction 
in  finite  dimensional  spaces  by  the  Kuhn-Tucker  tlieorcm  [lO]  which  gives 
a  necessary  and  sufficient  condition  for  the  existence  of  a  minimum  to  a 
convex  differentiable  function  over  a  convex  set  defined  by  a  finite  number  of 
differentiable  inequalities  subject  to  certain  additional  differential-geometric 
constraint  qualifications.  This  extension  is  made  in  terms  of  an  equivalent 
saddle-point  formulation  involving  additional  Lagrangcan  variables.  In 
general,  however,  these  arc  no  longer  related  to  any  dual  problem. 

Dual  theorems  for  nonlinear  functionals  and  constraints  in  finite 
dimensional  spaces  have  been  established  by  V/.  Fcnchcl  [ll]  in  terms  of 
contact  transformations,  but  the  related  problems  and  domains  of  definition 
are  presented  only  in  highly  implicit  forms.  The  most  explicit  result  to  date 
involving  non-linearity  and  with  separation  of  the  variables  of  the  dual  problems 
has  been  achieved  by  E.  Eisenberg  [iz]  in  the  form  of  maximization  of  a  con¬ 
cave  function  homogeneous  of  the  first  degree  subject  to  a  finite  system  of 
inequalities  related  to  the  convex  homogeneous  function  to  be  minimized  in 
the  dual  problem.  The  triple  is  subject  to  additional  qualifications  and 
somev/hat  implicitly  defined  dual  constraint  sets. 

Starting  from  a  little-known  work  of  A.  Haar  [13].  we  define  a  notion 
of  dual  "Haar"  (or  "semi- infinite")  programs  which  associate  minimization 
of  a  linear  function  of  finitely  many  variables  over  a  convex  set  defined  by  an 
infinite  (arbitrary  cardinal)  system  of  linear  inequalities  with  maximization 
of  a  linear  function  of  infinitely  many  variables  subject  to  a  finite  system  of 
linear  inequalities.  V/e  introduce  the  notion  of  "general  finite  sequence" 
space  for  the  latter  problem  and  establish  that  Charncs*  theorem  (associating 
linear  independence  and  extreme  points)  [S]  continues  to  hold  and  that  the 
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Oppositc  Sign  Property  of  Charnca  and  Cooper  [l4]  characterizes,  algebrai¬ 
cally,  convex  solution  sets  spanned  by  extreme  points.  (Note:  These  sets 
need  no  longer  be  bounded. ) 

Y/e  study  further,  applying  tlic  notions  of  "regularization"  to  these 
systems,  the  straightforward  duality  relations  between  these  programs, 
obtaining  (1)  an  extended  dual  theorem  precisely  paralleling  that  of  the  finite 
system  case,  (2)  a  general  dual  theorem  for  the  most  general  case  of  (finite) 
convc::  programs  by  expressing  them  in  our  (infinite)  form,  and  (3)  the  study 
of  any  (real)  semi- infinite  program  is  reduced  to  that  of  a  "Haar"  program. 

It  should  be  further  noted  that  our  dual  structure  appears  to  be  particu¬ 
larly  adapted  to  probing  the  borderline  between  properties  which  are  purely 
algebraic  and  those  which  require  topology.  Also  it  appears  to  offer  new 
possibilities  for  numerical  analysis  and  effective  solution  of  problems  of 
optimization  over  convex  sets  with  an  infinite  number  of  extreme  points  since 
it  substitutes  direct  algebraic  manipulation  and  minimal  topology  for 
differential- geometric  requirements  or  qualifications. 


Generalized  Finite  Sequence  Spaces  as  Solutions  Spaces 

By  a  generalized  finite  sequence  space,  5  ,  with  respect  to  an  ixidex 
set  I,  we  mean  the  vector  space  of  all(possibly  infinite)  vectorsLX.:  i  c  ij  over 
an  ordered  field  F  with  only  finitely  many  non-zero  entries.  Let  V  be  a 
vector  space  over  F  and  consider  a  collection  of  vectors:  P^,  {P.rici}  in  V. 
We  call  the  subapacc  R  spanned  by  these  vectors  the  "requirements  space, 
and  we  call  S  the  "solutions  space"  because  it  is  in  S  that  the  solution 
set  A  appears,  where 

A  =  {XcS;  \.P.  =  P  ,  X>  0}  . 
id  *  ‘  ® 

Clearly  A  is  a  convex  set  in  S . 
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Theorem  I  (Linear  Independence  by  Association  with  Extreme  Points) 

X.  0  is  an  extreme  point  of  A  in  S  if  and  only  if  the  non- zero  coordi¬ 
nates  of  \  correspond  to  coefficients  of  linearly  independent  vectors  in  R. 


Proof;  Assume  that  \  is  an  extrerae  point  of  A  ,  aivd  let  J  =  {i  e  I :  >  0}  . 

Assume  on  tiie  contrary  that  the  set  {P^^tie  J}  is  linearly  dependent.  Then 
there  exist  (3^  for  ic  J,  not  all  zero,  such  that 


icj 


p.P.  = 

'  1  X 


0  . 


Define  p  «  S  by  placing  zeros  in  other  coordinate  positions.  Since  J  is  finite 

and  X.  >  0  for  all  jej,  there  exists  k  >  0  such  that  X.  +  kp.  ,  X.  -  kp.  >  0 
J  J  J  J  J 

for  all  jcJ.  Set  X^^^=  X  -  kp  and  X^^^=  X  +  kp  .  Then  X^^^^  X^^^  since  some 

(i  ^  0  .  Moreover  X^^^,  X^^^c  A  and  X  X^^^  implies  X  is  not  an 

J  2  2 

extreme  point,  which  is  a  contradiction.  Hence  the  set  {P^  :  jeJ}  is  linearly 
independent. 

On  the  other  hand  if  XeA  is  such  that  the  set  {Pj  :  j  e  j)  is  linearly 
independent,  then  X  is  an  extreme  point.  For  if  it  were  not  we  could  write  X 
as  a  convex  combination  of  two  distinct  points  of  A  , 


X  =  iaX^^^  (i-p)x'^^  with  X  i 

Now  S  x!^^P.  =  E  x!^^P.  =  E  X.  P.  =  P  ;  but  the  non-zero  coordinate  positions 
id  ‘  ‘  id  ^  "  id  ^  ‘  ° 

of  X^^^  appear  among  those  of  X  •  and  therefore  the  only  P.  vectors  with  non-aero 


coefficients 


in  S  P.  arc  among  {P.  :j  e  j},  a  linearly  independent  set  which 
id  ^  ^  J 


means  that  the  expression  for  P  is  unique.  Therefore  x!^^  =  X.  for  all  j  <  J 

«  J  J 
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and  therefore  =  X.  .  Similarly  X  ;  This  is  a  contradiction  and  we 
conclude  that  X  is  an  extreme  point. 

Definition;  A  set  K  in  S  is  bounded  if  there  exists  M  e  F  such  that  for  any 

X«  K,  lx.  I  <  M  for  all  i  I  (or  alternatively,  if  2  I  X.l  <  M  all  X«  K)  . 

^  "  i«P  ^ 

Thus  if  X,  of«A,  the  ray  K  =  {X  +  iJia;  p  >  0}  is  not  a  bounded  set. 

Theorem  2  (Opposite  Sign  Theorem)  t 

A  is  generated  by  its  extreme  points  if  and  only  if  for  any  or*  S,  or  /  0  , 

2  o.  P.  =  0  implies  some  and  some  are  of  opposite  signs. 

Proof;  Suppose  that  A  is  generated  by  its  extreme  points,  and  that  there  exists 

Of^O,  or  >  0  such  that  2  a.  P,  =  0.  \?e  will  show  a  contradiction.  For  any 

i€l  ‘  ^ 

(i>0  ,  X  +  pacA  and  therefore  is  a  convex  combination  of  extreme  points 
of  A.  The  only  possible  extreme  points  that  could  occur  in  such  an  expression 
arc  tliosc  with  non-zero  coordinate  positions  among  those  of  X  +  per  for  all 
|i  >  0.  For  every  such  positioning  of  non-zero  entries  there  corresponds 
at  most  one  extreme  point;  otherwise  we  could  express  P^  in  two  different 
ways  v/ith  respect  to  the  same  linearly  independent  set.  Now  if,  say,  X  +  pa 

n 

has  N  non- zero  entries,  then  there  arc  at  most  2  N  such  extreme 

m=l  m 

points,  i.  c. ,  finite  in  number.  But  we  saw  above  that  X  +  pa  ,  for  all  p  >  0  , 
is  in  the  convex  hull  of  these  extreme  points,  which  is  impossible  since  the 
convex  hull  of  a  finite  number  of  points  is  bounded.  Hence  there  exists  no 
such  ac  S  as  above,  and  the  opposite  sign  property  must  hold. 


4 
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Suppose  now  that  the  opposite  sign  property  holds.  Given  X  e  A  ,  we 

must  show  that  it  is  a  convex  combination  of  a  finite  number  of  extreme 

points  in  A.  Suppose  X  has  N  non-zero  coordinates  and  is  not  an  extreme 

point.  V/e  will  show  that  X  is  a  strictly  convex  combination  of  X^^^,  X^^^c  A, 

each  of  which  has  at  least  one  fewer  positive  component  than  X  .  The  same 

construction  can  be  applied  to  X^^^and  X^^^  and  so  on,  until  an  extreme  point 

is  encountered.  This  is  a  finite  process  because  we  will  at  most  encounter 
N-1 

2  points  with  only  one  non- zero  coordinate,  each  of  which  is  extreme 

because  its  associated  vector  is  surely  linearly  independent.  Thus  after  all 

extreme  points  necessary  to  stop  the  process  arc  met,  we  can  reverse  the 

steps  to  express  the  original  X  as  a  convex  combination  of  these. 

It  suffices  to  carry  out  the  first  construction.  Thus  S  X.  P.  =  P 

jeJ  ^  J 

and  S  Of.  P.  =  0  ,  since  the  P.'s  arc  linearly  dependent.  Therefore  by  the 

jeJ  J  J  J 

opposite  sign  assumption  some  >  0  and  some  ag<  0, 

X.  X. 

Let  p,  =  min  — ^  and  p.,  =  min  — ^  ,  so  tliat  p,  ,  p,  >  0 . 

^  a.>0  ^  a  <0  |®j|  ^  ^ 

J  t) 


Set  X  '  =  Xj  -  pjOfj  for  jej  and  0  in  other  components. 


X^^^  =  X  +  o  a  . 
j  ‘  2  j 


Then  X^^^and  X^^^fA  and 


X  = 


.  (1)  .  .  (2) 
Pl+Pz  Pl+Pz 


Similarly 


Now  tlae  above  minimums  will  be  assumed  for  some  j2»j2*  J»  therefore 
X^^^and  X^^^have  at  least  one  more  zero  than  does  X. 

Q.  E.  D. 

The  following  example  shows  that  A  although  generated  by  its  extreme  points 
need  no  longer  be  bounded. 
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Exsonplc:  A  =  {X. :  §  2"^  V,  =  1  ,  X.  >  0}  evidently  has  the 

k=l  ^ 

opposite  sign  property  and  therefore  is  spanned  by  its  c:drome  points. 

Since  the  extreme  points  are  of  the  form  =  (0, . . . ,  0,  2^^,  0, , . . where 
k  til 

2  occurs  in  the  k  position,  A  is  unbounded. 

The  Extended  Dual  Theorem 

V/e  call  the  following  pair  of  problems  formed  from  the  same  data 
"dual  semi-ixifinite"  programs. 


I 

II 

min 

u'Tp 

max 

2  c. 

o 

iel  ^  ^ 

subject  to 

T 

u  P.  >  c. 

1  i 

subject  to 

2  P.  \.  =  P 
..11  o 
lel 

KeS,  X  >  0  . 

T 

lYhcn  F  is  the  real  field,  then  u  c  R  for  some  m  .  If  in  addition  the 

m 

T 

set  M  =  {(P. ,  c.) :  i  €  I }  is  a  "canonically  closed"  set  in  wc  call  these 

problems  dual  "Haar"  programs.  By  "canonically  closed"  is  meant  that 

T 

in  an  cqviivalcnt  inequality  system  (for  minimization)  in  which  the  (P.  ,  c.) 
form  a  bounded  set,  this  set  is  closed. 

In  most  of  his  theorems  on  linear  inequalities  liaar  only  includes 
closure  of  M  as  a  basic  assumption.  However,  we  can  see  readily  (by 
counter-example)  that  he  really  meant  a  little  more  than  this,  that  is,  that 
the  set  M  be  canonically  closed.  Haar's  theorem  on  inliomogcncous  in¬ 
equalities  is  stated  as  follows. 
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Theorem  3  (Haar's  Theorem  on  Inhomogeneous  Inequalitieo) 

Let  *  * ''^n^  ”  *  * '^®^kn'*n^^kn+l  ^  with 

(u,iU_, . , .  ,u  )  viewed  as  in  R  .  If  D(u,,  u., . . .  ,u  )  =a,  u,+, .  ,+a  u  +a  . ,  >  0 
16  n  n  16  nil  nn  nTi  ~ 

is  a  consequence  of  the  caiu>nically  closed  system  1^^  >  ^  then  there 

exist  Xj^>0,  X>Q>  0»  with  at  most  n  + 1  non- zero  such  that 

°<"1 . “n>  =  I  . V  +  ’^o  • 

The  proof  of  this  theorem  along  with  other  results  of  Haar  appear  in  the 
appendix. 

Theorem  4  (Extended  Dual  Theorem) 

For  any  pair  of  dual  Haar  programs  precisely  one  of  the  following 

occurs: 

(i)  sup  E  c,\.  -  «>  and  I  is  inconsistent 
i«I  ‘  * 

T 

(ii)  inf  u  P  =  -<»  and  II  is  inconsistent 
o 

(iii)  I  and  II  arc  both  inconsistent 

T 

(iv)  inf  up  =  sup  S  c.  X.  =  E  c.  for  some  \*f  A , 

°  id  '  ^  id  ‘  » 

Before  v/c  turn  to  the  proof,  let  us  consider  some  examples  of  the  above 
situations. 

Examples:  Let  I  =  {1,2,...} 

I  n 

(i)  Min  u  Max  E  (-l)^\j^ 

subject  to  2"  u>(-l)^  k=l,  2, . . .  subject  to  E  2“^X.  =  1 

k  * 


0.u>  0 


X^>0  . 
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Clearly  I  is  inconsistent.  Howeveri  for  II  take  k  large  and  even  to  see  that 
\  =  (0| . . .  1 0,  2  , 0, . . . )  is  a  feasible  point  which  means  that  the  maximum  is 
larger  than  2  .  Hence  since  k  can  bo  arbitrarily  large  Max  =  +  oe  . 

I  U 

(ii)  Min  u  Max  (-Xj^ 

subject  to  u(-2’^)  >  -1  subject  to  S  (-2"^)  1 

kel 

0-u>0 

Clearly  n  is  inconsistent,  and  feasible  u  consist  of  u:^  0 ,  i.  e. ,  Min  =  . 

(iii)  1  II 

Min  u  Max  £  X, 

k 

subject  to  u(-2"^  >  1  subject  to  S(-2"^)  X.  =  1 

k  ^ 

O.u^O  Xj^iO 

Both  I  and  II  arc  inconsistent. 

(iv)  Consider  as  the  constraint  set  the  points  under  the  curve  y=tan'*\x), 
with  x  >  0  and  above  the  x-axia. 
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V/e  observe  that  the  equation  of  the  tangent  line  at  the  point  (x,  tan'^x) 

^  -1 

u.-  tan  X 

is  given  by  -  =  -  and  therefore  our  constraint  set  is  given  by 

"l  ■  *  l+x2 

the  following  system  of  inequalities 

Uj(l+x^)”^-  U2  >  -tan  ^x  +  x(l+x^)”^  = 

U2>  0 


Let  the  direct  problem.  I,  be  min  (-u^)  subject  to  the  above  constraints. 

In  this  example  the  set  of  coefficient  points  is 

{  (Itx^)  \  -1,  -tan”^x  +  x(l+x^)'*^)  :  x  >  0  }  in  addition  to 


the  points  (0,1,0)  and  (0,-1,-  .  Clearly  this  set  is  compact,  since  the  limit 

point  (0,-1,-—)  as  x  —  «>  is  added.  Note  that  min  -u,  =  -max  u-  *  -  -5  is 
2  2  2  2 

never  attained  because  feasible  points  must  lie  on  or  under  tlie  curve. 

For  tliis  example,  the  dual  II  is  as  follows. 

,  /0\  /0\ 

If  we  let  ”  y  /  ’  ~  i  y '  \  )*  have 


max  "Sc  X  +0»X  +(--5)X_ 

XX  a  2  P 

subject  to  ^x^x'*'  V  ^  X»8  >  0  . 

V/e  see  that  if  \-  =  1  and  all  other  X's  =  0  ,  then  the  maximum  -  —  is  attained. 
^  2 

Lemma  1  If  both  I  and  II  are  consistent,  then 


inf  u 


=  sup  2  u”p.  X.  =  2  c,  X? 
°  i.i  ■  ‘  1  ‘  > 


for  some  X*e  A  . 
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Proof:  VfQ  observe  that 


u^P  =  r  u^P,  >  y-  c.\.  .  Thus  inf  ii^P  >  sup  ScA. . 
o..  O”*  11 

id  i€l 

Let  z*  =  inf  u^P  .  Then  u'^P  >  z*  whenever  u'^P.  >  c.  all  i  . 

O  O  11 

By  Haar’s  inhomogeneous  extension  of  the  Farkas-lvlinkowski  lemma 

it  follows  that  for  all  u.  ,  ^  v'*+  v*  ,  where  v?,  Vq  ^  0 

J  id 

and  is  in  S  • 


Thus 

and 

Hence 

so  that 


P  =  S  r.  vf  , 

O  ..11 
id 


so  v’*'e  A 

2  c.  V?-  v*** ,  or  z*<  S  c.  V?  . 
id  ‘  ‘  ^ 


1  1 


1  1 


Sc.v?>  z*  =  inf  u  P  >  sup  2  c.X. 

ii~  o~  *^.11 

1  1 

A  T 

2  c.  vT  =  sup  2  c.  X.  =  inf  u  P  . 

11  *^.11  o 


Q*  2t  D* 


This  may  be  strengthened  to 
Theorem  5 

T 

The  results  of  the  lemma  hold  if  {  (IV*  c^) :  i  c  1}  has  the  Farkas- 
Minkowski  property,  that  is,  if  for  any  inequality  D  >  0  which  is  a  consequence 
of  the  system  Dj^  >  0  ,  there  exist  >  0  ,  >  0  (oaly  finitely  many  non¬ 


zero)  such  that  0=2  X^D^^  ^  X^  .  In  the  appendix  it  is  shown  that 

k 

canonically  closed  systems  have  the  Farkas-Kiinkowski  property. 

Proof  of  the  Extended  Dual  Theorem 

Adjoining  artificial  variables  and  bounding  constraints  to  the  given 
problems,  we  obtain  the  following  regularized  version.—^ 


Compare  this  formulation  with  the  finite  problem  regularization  given  in 
^  Management  Models  and  Industrial  Applications  of  Linear  Programming. 
A.  Charnes  and  W.  W.  Cooper,  pp.  189-190,  Vol.  1. 


.12. 


min  u  M  +  u  P 
o  o 


min  r  c.  X.  -  U  e^(v^+  v  ) 
i.i  ‘  ‘  ^ 


subject  to  +  u^Pj  >  Cj  subject  to  X-j  ^  ^ 

“^■0.2 -Uol 

-u^l  >  -U  where  X  ,  X.  >  0  ,  i  «  I ,  and  v|,  v‘  >  0 

m”  m  o  1  j  J 

u  >0 

o  ” 

Clearly  is  consistent,  for  take  u"^=  0  axul  >  sup  {c.},  since  {c^:  i  €  1} 
is  a  compact  sete  As  for  take  X .  =  0  (ici)  and  v"^-  v"=  with  X^  =  M  . 

Note  in  addition  that  the  system  is  still  a  Haar  system  because  addition  of  a 
finite  number  of  coefficient  points  cannot  destroy  compactness  of  the  coefficient 
set.  Hence  we  can  apply  the  lemma  to  the  regularized  version  to  conclude  that 


T  *  e  +  - 

inf  {u  M  +  u  P^}  =  S  c.X%  U  2  V  ,  where  v.  =  v.  -  v.  . 

®  °  id  ‘  ‘  j=l  J  J  J  J 


Furtiier,  the  relevant  set^^  non-empty  and  compact  since  it 

is  the  intersection  of  closed  sets  (half- spaces)  and  by  regularization  is  non¬ 
empty  and  bounded.  Thus  by  compactness  the  "inf"  is  actually  assumed  for 
some  u* ,  u*^.  The  following  possibilities  are  therefore  mutually  exclusive 
and  collectively  exhaustice  for  u^  and  v  =  (v  ,  v  ) .  l/e  tabulate  them  with 
the  correspondingly  numbered  conclusion  of  our  theorem. 


(i) 

v*=0  ; 

I  no  solution  ,  sup 

S  c*  X,  — 
i  ^  ^ 

(ii) 

c 
o  « 

II 

o 

0 , 

II  no  solution  ,  inf 

u'^P  =  -  « 
o 

(iii) 

U^M, 

o 

neither  I  nor  II  has 

a  solution 

(iv) 

u*  =  0, 
O 

o 

II 

« 

> 

both  feasible  and  inf 

T  4* 

u  P  =  sup  S  c,  X.  =  S  c  .X. 
o  1  i  i  i  ‘  i 

foi*  some  X*  in  A , 

1  /  only  bounded  u  are  relevant . 
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Although  for  some  pw poses  it  may  be  vital  to  deal  with  a  semi-infinite 
program  as  presented,  for  most  cases  the  object  of  primary  interest  will  be 
the  nature  of  the  solutions  to  the  system  u  >  c^ ,  i  <  1 .  \7e  have  already 
pointed  out  that  any  such  system  is  equivalent  to  one  in  which  the  c^}  are 
boxmded  (for  each  ineqxiality  can  be  separately  divided  through  by  the  maximum 
of  the  absolute  value  of  its  entries).  With  regularization  the  most 

gexieral  case  is  brought  under  the  foregoing  by  the  observation  that 


Lemma;  The  canonical  closure  of  a  system  of  linear  inequalities  has  the 
same  solution  set  as  the  original  system. 

T  fnlT 

Proof;  It  suffices  to  show  that  if  (a  ,  a)  =  lim  (a'  '  ,a  )  and  a'  '  +  0  » 


n 


n  =  1,  2, . . .  then  a'^  u  a  >  0  . 


(ni 

Suppose  one  could  have  a*u+a  =  -6<  0  with  a'  ^  ® 


But  then 


r  T 

0  <  a^”^  +  ^  +  («“«_)]  <  ior  n  >  n  (5) . 


This  is  a  contradiction  and  therefore  we  conclude  a''^u  or  ^  0  . 


Q.  E.  D. 


Thus  by  reducing  them  to  equivalent  Haar  programs  we  have  achieved  a 
duality  theory  for  semi- infinite  programs  as  complete  as  that  in  the  fixiite 
situation. 

To  obtain  the  general  convex  programming  dual  theorem,  we  move  the 

functional  into  the  constraints  and  replace  it  with  a  linear  function  as  follows. 

Suppose  tibe  direct  problem  is:  min  C(u)  subject  to  G(u)  >  0,  where 
T 

G  =(...,  G.(u), . . . )  is  a  finite  vector  of  concave  functions  which  defines 

T 

the  convex  set  Y/  of  the  u's.  Let  u  P.  ^  c^,  id  be  a  system  of  supports 
T 

for  Vf ,  and  z-u  be  a  system  of  supports  for  z  -  C(u)  >  0  . 
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Then  the  direct  problem  may  be  rewritten  as : 
min  z 

T 

subject  to  z  -  u  >  d  , 

ot  ot 

T 

uP.  >  c.  ,  aeA,  iel.  Thus  we  have 

1  “  1 

Theorem  5 

Assuming  the  Farlcas-Milkowski  property  for  this  system,  the  extended 
dual  theorem  applies  to  the  following  dual  programs: 

max  S  d  |J.  -(■  Z  c.  X. 

a  a  .11 
a  1 

subject  to  Z  lA  =1 

a 

-Z  Q  |i  +  Z  P.  X,  =  0 
or'^a  .  1  i 
or  1 

H  ,  X.  >  0  . 

Since  the  work  of  A.  Haar  utilized  above  is  not  available  in  English, 
we  have  prepared  a  free  translation  of  it  which  is  contained  in  the  following 
appendix,  together  with,  first,  a  rendition  of  the  pertinent  remarks  and 
theorem  of  Caratheodory*s  which  Haar  refers  to  and  employs. 
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^  APPENDIX 

A,  PRELIMINARY  REMARKS  BASED  ON  CAIlATHEORORY«8  OW)  PAPER 

la  addition  to  tho  notion  of  convexity*  Caratheodory*s  convex  eeta*  K , 
are  closed.  He  diacusaee  outer  poiata  and  boundary  pointa  of  a  convex  set, 
agreeing  with  the  usual  intuitive  meaning.  A  boundiag-hyperplaae,  h ,  is  a 
hyperplana  uddch  does  not  meet  K ,  and  does  not  separate  points  of  K ,  i.  e. , 
ttere  caa*t  be  poiata  in  K  for  udiich  h  >  0  and  points  for  udtich  h  <  0 .  This 
concept  is  extended  to  cases  udtore  K  is  a  closed  and  bounded  set,  i.  e. , 

X  is  compact. 

Now  given  any  compact  set  MCR^,  the  space  of  n-tuples  of  real 
numbers,  let  K  be  the  collection  of  all  points  tiirough  which  no  bouading- 
hyperplaae  can  be  drawn  for  M  * 

I..emma;  K  is  the  smallest  convex  set  containing  M . 

Proof:  K  is  bounded,  for  let  A  «  maximum  distance  of  M  to  the  origin  O. 
Then  each  plane  whose  distance  from  O  is  >  A  is  a  boundiag-hyperplaae 
for  M ,  and  hence  each  point  greater  than  Adistaace  from  O  is  not  in  K . 

K  is  closed:  for  let  a  be  an  accumulation  point  of  K .  If  a  f  K,  then  we  can 
pass  a  bouading-hyperplaae  for  M  throu|^  a ,  say,  s ,  with  distance  p  frma 
M .  But  Ais  means  we  can  pass  bomidiag-hyperplaaes  through  points  of 
distance  less  ttiaa  p  from  a .  Hence  a  cannot  be  arbitrarily  close  to  points 
of  K  which  is  a  contradiction.  Hence  a «  K,  and  K  is  closed  in  R^. 

Now  if  a,  bsK,  a  ^  b,  and  c  is  any  point  on  iS*  tfien  csK.  For 
if  not,  pass  a  bouading-hyperplaae  s  for  M  throu|^  c ,  then  a  and  b  are 
not  on  s ,  and  therefore  lie  on  different  sides  of  s.  But  depending  on  which 
side  of  s  M  is  on  we  can  shift  s  eitiMr  through  a  or  b  to  get  a  new 
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bouadiiif-hyperplana  for  M.  This  ii  impoaiiblo  since  a«bcK  .  Hence  ccK, 
end  K  is  convex. 

If  L  is  any  convex  set  contaiidng  M  and  L*  then  we  can  pass  a 
bounding-byperplanst  s*  for  L  through  p.  But  s  is  also  a  bounding- 
hyperplane  for  M  and  therefore  p  ^  K  by  definition.  Hence  K  C  L ,  and  K 
if  the  smallest  convex  set  containing  M  • 

Main  Theorem!  Let  M  and  K  be  as  above.  For  any  c  s  K  •  there  exist  a 

finite  number  of  points  of  m  and  masses  m^  with  m^^^  0  and 

n  n 

£  m.  «  1  such  dutt  c  =  £  m.  p.  . 

i«l  *  i«l  ‘  ‘ 

Proof;  Dimension  M  «1 :  let  a  and  b  be  the  extreme  points  of  M .  Then 
every  point  of  K  is  of  the  form  c  »  ta  I-  (1-  t)b.  0  <  t  <  1. 

M  . . -  . .  -  -  - - -  - 

a  b 

Assume  that  die  statement  is  true  for  (a-l)-dimensional  space  (or  equivalently 
for  (n-l)-dimensional  subspaces  in  R^) . 

Let  K  and  M  be  in  R^.  Given  c  s  K»  let  m  be  any  point  in  M,  and 
form  me  and-  b  |tha  intersection  widi  die  boundary  of  K.  If  c  is  interior 
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to  K,  tiien  we  can  find  b  ^  m.  Now  paee  a  "eum^ovtiag-plaaei''  ■ ,  Hirough  b  ' 
having  propertiee  (1)  b  «  S :  (2)  all  point*  of  K  lie  on  only  one  aide  of  ■  ; 

•  neeesearily  intereecta  M  ,  ofherwiae  it  would  be  a  bounding-hyperplane 
for  M  •  Let  M*  be  thia  intoraoetion.  It  baa  at  leaat  1  lower  dimenaion 
tiuA  M  and  by  aaaumption  there  are  point*  p^tM*  wiOi  maaaea  auch  tiiat 
n 

b  ■  Z  m.  p. .  Now  we  know  tiuit  c  «  tm  -f  (l-t)b  for  aome  t ,  0  <  t  <  1 . 
i«l  ‘  ‘ 

a  n 

Hence  c  ■  tm  Z  nx.(l-t)p.  and  t  -f  Z  m.(l-t)  ■  1.  Hence  we  have  proved 
i-1  ‘  ‘  i«l  ‘ 

Am  aaaertion  for  dimenaion  n*  and  by  induction  the  aoaertion  holda  for  all 

n2  1  • 

B.  SYSTEMS  OP  LINEAR  XNEQUALXTIBS  (THE  HAAR  PAPER) 

1«  Honaogeneoua  Inegualitiea 

Let  Oj^(U|,U2* .  • « *u^)  «  ajjUj+  ai^u^’f* » .+  a^^u^  *.vhoro  k  range*  over 
aome  indexing  aet  1  and  are  real  number*.  Let  D<u^(U2i . . .  .u^)  ■ 

■  *1^'^  *2^2^* *  view  tiie  Dj^'a  and  D  aa  linear  functional*  on  R^. 

Conalfdar  ■  ^*kl**k2' * '  *  **ka^*  ^ 

M  ■  ^ :  kal) .  We  any  that  tiia  ayatem  of  inequallHea  0  ia  cloaed 
if  M  ia  a  cloaed  aet  in  R. .  In  moat  of  the  theorem*  Hear  inchadea  cloaure 
M  M  a  bnaic  aaaumption.  However,  we  can  aee  thM  he  really  meant  a 
little  naore  than  thia,  ttnit  is,  that  ttae  aet  M  be  "canonically  dosed"  in  the 
sense  that  ttisre  exist  posltiv*  constants  {C|^: kal)  such  Bis  set 
hi  •  (P|^/C|^:kal}  ia  not  only  cloaed  but  bounded  (compact).  InBda  case  we 
call  the  system  ®  canonically  cloaed.  In  addition  we  say  that  the 


■10“ 


inaquality  D  >  0  ii  a  conaaquence  of  the  ayetem  >  0  if  every  aolutipn  of 
the  ayatem  ftUfiUa  D  >  0  • 


Theorem  1;  U  O  >  0  ia  a  coaaequence  of  the  canonically  cloaed  ayatem 
>  0 .  then  there  exiat  non-negative  numbera  with  at  moat  n  of  them 
aon-aero  auch  that 


D  *  S  X.  D.  . 
kcl  *  * 

Proof!  Let  DaO|^/c^  vdiere  0  are  auch  that  i^/c|^:kcl  ia  compact. 
If  the  theorem  ia  true  for  D|^*  tiien  it  ia  alao  true  for  :  for  ia  that  caae  we 
have 

®  \  ®k  *  St  *  S^®k  • 


Thua  we  can  aaaume  that  M  ■  |p|^ :  k  f  z|  ia  compact.  V/ithout  loaa  of  generality 
we  can  aaaume  that  ttiore  ia  a  vector  *0  ■  *  *  *  *^||)  ^ 

for  all  k  a  Z  .  OUierwiae  we  have  |x :  x  >  0|*  OzDi^O)  . 

but  the  aubapace  oa  the  right  hand  aide  haa  dimenaioa  <  a- 1  ao  that  we  don't 
need  a  variahlea. 


Let  . *1*^  forkaZ. 

^  a 

Then  P.  all  lie  ia  the  hyperplaao  E  given  by  Z  x.  ■  1  .  aince 

i«l  *  * 

*i^ki  *(j*|*ki'‘i^^^®k^  *  ^  equivalent  ayatem 

®k^®k^  "  ^kl'*l  ^kZ'^Z  ^ka^B  -  ®  where  now  the  coefficient  pointa 


P|^  lie  on  E  . 


i 
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Lmm»  It  The  eet  ^  *1  Pj^:  k  <  if  compact  in  !l^« 

Proof:  For  every  Pj^  ■  ^*^151*  ^c2*  *  *  * '  *^^  ‘  ^  define  (p^)  ■  Dj^  (u)  . 

Since  Z}^(u)>  0  for  all  k«X  ,  f^  >  0  on  M  .  Clearly  £•  ia  continuoue  on  M  * 
and  therefore  ae aumee  ita  abaolute  minimum  and  maximum  on  M .  i.  e.  we 

can  write  0  <  m,  <  f.  <  m,  on  M .  Now  we  obaerve  that  A  : x  c  M> . 

Immediately  we  can  aee  that‘^  ia  bouiuled  aince  Mia.  M  ia  cloaed  : 


for  let  —  ■  — ^  y  aa  m  — >  •<> ,  Then  \  x^V  ,  aa  an  infinite  aequence  in 
f|^<xm)  ’ 

M  t  haa  a  limit  point  x  in  M ,  and  hence  a  aubaequence  x^  — >  x  aa  i  < 


Hence 


aince  ^(x)  ^  0  .  Since  every  aubaequence  of  a 

%<>W>  *5  W 

convergent  aeqttence  convergea  to  that  limit  of  the  aequence.  we  conclude 


■  y,  i.  e.  ycMf  and  M  ia  cloaed. 


To  give  tide  new  ayatem  a  geometric  interpretation,  let  u^  »  ■**  u^ 

U2  ■  U2  >  •  •  •  •  ^  aolution  of  thia  ayatem  and  let 

. ^ . '^n^  * 

,|^i<''i*^>  n 

»  - -  ZA,.U.+  1  foraUkaX. 

D^(u)  i«l  ~  ‘ 

The  ayatem  U|.U2»...  .U^  ia  ttien  a  aolutioa  of  the  inoqualitiea 


li9t  ua  look  for  interaection  peinta  of  tte  hyporplano 
U|Xi+  U2X2'l- . . .  +  UjjX^+  1  «  0  witti  ttie  vectora  .  whore  O  ia  the  origin. 
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EitJwr  Ihara  ii  ao  intarseetion  with  tha  lina  at  all  in  which  eaaa 

0  ,  or  intersection  point  has  the  form  . 

X  a  a  a ,  pAj^)  whore  p*  §  .."/iTJ'yn  * 

Ic  1  n 


1 0  <  X  <  which  is  equivalent  (from  the  graph)  to  Oj^  > 
plane  has  no  interior  intersection  with  tib»  segment 


in  the  interval 
0  a  Hence  our  hyper- 
if  and  only  if 


V"l'"2 . «n'  >  «• 

These  hyperplanes  can  be  characterised  in  another  way.  We  have  seen 
that  the  points  of  M  •  i.  e.  (P|^:  ksl|  all  lie  in  the  hyperplansi  E  and  tiiat  A  is 
compact.  In  Caratheodory*s  sense  let  K  be  the  smallest  convex  set  in  E 
containing  A .  Connect  all  points  of  K  with  die  origin  O  to  get  an 
n-dinMnsional  convex  set  K»  i.  e.  K  »  [ (eX|t ...» ex^) :  (xj, ...» x^)  tlc  , 


Lonima  2;  The  hyperplane  U^x^  U^x^-t  1  ■  0  does  not  have  an  interior 

intersection  with  for  all  k  s  X »  if  and  only  if  it  does  not  separate  K  • 


“Zr 


Proof;  <*  :  Assume  the  hyperplane  does  not  separate  K,  i.e., 

TT*.+  +UX+1  has  the  same  sign  on  K ;  but  since  0«K,  we  have 

..  ^  ^ 

UjXj  + . . .  +  U^x^+  1  >  0  on  K.  Since  Pj^  t  K  (k  €  I),  we  have 

(k€l)*=>  ^ 

the  hyperpUne  has  no  interior  intersection  with  any  of  the  OPj^  . 

=>  :  Assume  the  hyperplane  has  no  interior  intersection  with  any 

OTj^ik.l).  i.e..  ej^(Uj . Un>=iVki'^i^^-°*  By  the  main  theorem  of 

Caratheodory.  if  (x^ . x^)  €  K.  we  can  write  x^  =  with  >  0 

and  r  =  1  and  at  most  being  non- zero.  Hence  for  each  k  we  have 


S^H^AkfUi  +  >  0  therefore  0  <  k  ^  ^  ’ 

Hence  for  any  e,  0  <  e  <  1 ,  we  have  0  <  (eXj)Uj+  1  «  ^ 


for  any  (xj . xj  s  1  >  0  ,  i.  e. .  the  hypcrplane  does  not 

separate  K. 

Thus  far  we  have  been  building  machinery  for  the  proof  of  Theorem  L 
Lemma  3  D^(n)  >  0  for  all  =>  D(u)  >  0 

Proof;  Y^e  have  seen  in  the  proof  of  lemma  1,  that  for  f-  defined  on  M  by 

'i  <I>k>  =  'u  <»ia . ‘kn*  =  Dull).  0  <  "h  i  'i  i  ”2  •  _  “  “  ^  “ 

show  that  given  s  >  0  ,  if  u*  is  in  some  6- neighborhood  of  u ,  Ng(u) ,  then 
|f^,(PjJ  -  <Pk)l  <  •  all  p^ «  M .  Caioose  •  -  ^  so  that  for  u*s  N^Cu) , 


•in 

-r*  W  W  ^ 


iicnee  for  any  u*€  Ng(u)  , 
2 


m,  nV| 

-r  ^  <  ^  +  ->  »^  >  0  on  M  . 
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Suppose  now  D(u)  ■  0 .  Then  since  D  is  a  linear  fxuictional  on  not 
identically  aero,  there  exists  a  ut'aR^  such  that  0(u<')  s  l. 

Set  u'  *  il  -  6  . 

Then  u'cN^iu)  so  that  ^  all  kd.  Hence  since  D  is  a  consequence 

of  the  systenrx  D.  >  0,  we  have  D(u*)  >  0 .  But  D(u')  =  0  -  <  0  which  is  a 

K—  —  ||U  II 

contradiction.  Hence  D(u)>  0. 

^1  ^ 

Thus  set  A,  =  — ^  , . . . ,  A  =  —  ,  where  D(u)  =  £  a.  u. , 

^  D(u)  "  D(u)  i=l  ^  * 

n  .  /  »  -\  1 

so  that  £  A. u,  =  (  £  a.  u.\ - =  1  =>  the  point  P  ::  (A,t . . .  >  A  )  lies  in  E. 

i=l  ^  ^  \^i=l  ^  Md{u)  ^  “ 


Lemma  d  Let  (Uj, . . .  he  a  hyperplane  not  separating  K  ,  then 

e(Uj,....UJ  s  D(Ui+^ij . 1  >  0. 
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Proof!  For  such  a  hyporplane  we  know  •  U^)  >0  (k  c  I)  because  by 

lemma  Z,  thie  plane  has  no  interior  intersection  with  i  i.  e.  • 

.  * .  •  U^)  >  0 .  But  ^is  means  -i-  u^i  •  •  t  >  0 ,  for  all  k  •  hence 

D(U,  +  u,....,U  +u  )  >  0,  honco  e(U,,...,UJ  =  >  0,  which  was  to  be 

^  ^  n  n  -  1  n 

Consequence:  For  such  hyperpianos.  6(U^. ...» U^)  >  0 ,  which  means  by  our 
previous  geometric  interpretation  tfiat  tiie  hyper  plane  has  xio  interior  inter¬ 
section  with  m 


Lemma  5:  P  »  (A . .A  )  is  in  K. 

I  II 

Proof:  V/e  know  that  P  t  E.  Thus  it  suffices  to  know  P  •  K.  Assume  on  the 
contrary  tiiat  P  f  K .  Then  since  K  is  closed  there  exist  interior  points  of 
O?  also  not  in  K.  We  can  pass  a  bounding-hyperplane.  s  .  tiirou^  one  of 
these  since  a  convex  set  is  the  set  of  all  points  for  which  tiiis  cant  be  done. 
But  this  contradicts  the  above  conseqwnce  of  lemma  4.  Hence  P  s  K  and 
tiierefore  P  <  K . 

Hence  we  can  write  A,  *  E  ivA. ,, . . . , A^  *  £  ^  l*v  ■  ^ 

*  kfl^  "  “  kfl^  ^  ktl^ 


with  at  most  n  non- aero 


Hence 


•(U)  *  E  A.U.  +  1  «  E  E  +  1  ■  Eli.  (  E  A.  .U.+  1)  «  E  p.  ».(U)  . 

i»l  ^  *  k  i«l^  “  ‘  k  ^  i«l  “  ‘  k  ^  * 

-  §(U) 

Hence  0(u)  •  D(U<^u)  mJaUm  5 - -  s  ...fLg  ■  ■  ,  . 

D<u)  D(u)  k  Di^Dy^u) 


m  E 
ksX 


'»*k°k<^ 

D(u) 


D^<u) 


E  Xj^D|^(u)  and  theorem  1  is  proved. 


>  0 .  and  at  most  n  of  thmm  are  non-sexo. 


{ 
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2«  liAomogeneom  Ineqt»alitie« 

Theorom  1  abov*  dealt  wi13x  the  homogeneous  case.  For  the  inhomo¬ 
geneous  case  let 

“k<“l . “n*  ■  *kl“l  +  •  •  •  +  •to+l  ■ 

kcl  with  (u^« .  • . . u^)  viewed  as  in  .  Let  M  g  {p^ s  » » . , a^);kt I ) 
as  before. 


Theorem  2 

If  D(uj, .... u^)  *  ajtij  + . . ,  +  >  0  io  a  consequence  of 

the  canonically  closed  system  0  (k«D.  then  there  exist  >0.(ksD  v/iih 
at  most  nfl  non-sero  sucbttiat 


D(Uj. 


'V 


',=  Sc“k‘“l'V 


. . . .  tt^)  + 

n  o 


Proof;  V/e  can  assume  existence  of  ((^* . . .  ,u^)  «  u  such  diat  0  , 

otiierwise  0  Dr^(O)  =  0  Dr^(  >  0)  and  H  Dr^(  >  0)  will  be  a  translate  of  an 
k*'  k*“  k*" 

(n-l)-dimensional  subspace  so  we  can  reduce  tiie  number  of  variables. 

Again,  set  . . . . U^)  =  Dj^(Uj ♦  Uj . . 


•  . 

n  aj.  n 

*  r  — —  U.  +  1  »  S  A- . U .  +  1  ,  where  A|. 
ial  Dj^(u)  ‘  i«l  “  ‘  “ 


^d 

Dk(5) 


I'^t  CA|^. ....  A^^)  ■  . 

Then  consider  the  hyperplane.  h .  given  by  U.x.  f...fU  x  -t-lsO.  Then 

i  A  n  n 

Just  as  in  tile  homogeneous  case  we  can  prove  the  property: 

A)  has  no  interior  intersection  with  h  <  *>  •jjiUj. ....  U^)  >  0  . 
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L«t  K  b*  imallaat  conwx  sat  coataiaiag  O  mad  Pj^  #  Tbia  is  tha  sama 
K  as  bafora,  and  siaca  M  la  compact  tha  sat  {Ot  I^*ktX)  is  again  compact 
insida  K  •  As  balora  wa  saa  dutt 

0(^. . 

e(u,,...,uj  «  M  r  u,  -  5  A.U.  + 1  >  o 

‘  “  D(u)  i*l  D(u)  ‘  i«l  ‘  '  “ 


,ttj>  0  yjtfi 


,  u.)  >  0 ,  and  tharalora 
n 


Hanca  wa  hava  tha  following  rastatamant  of  lamma  2: 

T 

B)  D  >  0  is  a  consaquanca  of  >  0  < ^or  aay  hyparplana  ••• , U^) 
not  saparating  K  wa  hava  d(U|» .  * .  *  U^)  >  0 . 

Lot  P  ■  (Aj . 


Clain  P  c  K .  If  not*  lat  d  «  diatance  from  P  to  K  raaliaad  from  soma  poiat 
Q  «  K  •  siaca  K  is  compact.  Pass  a  hyparplana*  s »  throu|^  an  iatarior  point 
of  QP  which  doas  not  aaparala  K*  say  ^  know 

U|Xj‘t « , .  <f  1  >  0  ^  vdiola  half-spaca  in  ahich  K  lias.  Siaca  P  ia 

n 

not  dda  half-apaca*  Z  V.Ai'f  1  <  0  for  P*  which  ia  Imposslbla  by 

i«l  *  • 

proparty  B).  Hanca  P  s  K.  By  Carthaodory*a  thaoram  ttara  axist  . 

^o*  ^  widiatmoat  nfl  non  aaro  (siaca  ttia  dimaasioa  of  K  is  n)» 


sudi  that 


"26» 


and  Aj=|x^*0+  £  Aj^  ,  for  i^l,  2, . . .  ,n 


and  £ 

kcZ 


**16  . ^  k^I  i=l  ^  ^  ' 


ialik*!  ** 


+  £|i  =  £AjU  +(l-ti^)=  e(U^ . U^)-n^ 

k  i=l 


Hence  6  (U^t . . .  ♦  U^)  =  £  ....  U^)  +  |ji^  .  Since  D(u)  and  “k'">  ^  ® 

kd 

we  can  make  the  necessary  adjustments  to  the  6's  as  before  to  get 

D  =  £  X.  D.  +  \  widi  X.  >  0,  k€l,  and  at  most  n  +  1  of  the  X. 's  non-sero. 
k,i  K  K  o  k  K 


3.  Parameter  Representation  of  Linear  Inequalities 

Since  the  convex  set  K  is  compact,  K  is  bounded  by  a  finite  number 
of  hyperplanes,  i.  e. ,  K  is  a  polyhedron.  The  hyperplane  E  witiix  equation 
Uj^x^-h, . .+  °  1  i>  one  of  these  axid  we  know  that  for  all  (x^, . . . ,  x^)  <  K  , 


-UiXi 


-  u-x-  -  ...  -  U^x^  +  1  >  0  . 
c  c  n  n  ** 


Since  all  of  the  remaining  hyperplaneo  go  through  the  origin  0  ,  they  have  equa- 
tipno  '4*^^  '*’*  *  •'*’  ®  2, . . . ,  N),  where  the  coefficients 

,u|^^  can  be  chosen  so  that  for  all  points  of  K  we  have 

Uj^^Xi  +  . . ,  +  n|^^x^  >0  (q  s  1,  2, . . . ,  N)  . 

Hence  the  points  (x^,  *  •  *  of  K  can  be  characterized  as  tiiose  (and 
only  those)  satisfying  the  following  N-f  1  inequalities 

Uj^^Xi  + . . .  +  ^  0  q  =  1,  2, . . . ,  N 

-UiXj-  .,..u^Xn  +  l>0 


“Z?" 


Th«or«m  3; 

+  U|  *  ^2  ^2*  *  *  *  *  ^  solution  of  the  ineqiuilit/  ayetem 

Dj^j2  0<a^  U^x^f...^  U^x^4- 1  >  0  is  a  conaequence  of  the  N+l  iBequalities(*). 
Proof  ■B>if  D|^(V^ ^  U|, . . . , U^-f  u^)  >0,\fkt  tfien  we  have  seen  that  a 
(U^f . .  •  •  U^F'plane  doea  not  separate  K*  i.  e.  •  U^x^'f. .  ^  ^  ^  ^ 

(X|« . . .  •  x^)  <  k  •  i.  e.  •  the  eystem  (*)  holds  for  (X|« . .  •  *  x^)  . 

T 

<  ■■  :  From  this  assumption  it  follows  that  the  hyperplane  (U|( ...  *  U^) 
does  not  separate  K  *■>  it  dees  not  have  an  interior  intersection  with  ^ 
segments  OPj^  •*>  Dj^(Uj+Uj, . . .  u^)  >  0  . 

Hence  u^, . . .  u^)  satisfies  all  k  if  and  only  if 

there  exist  non-negative  numbers  (q  ■  1, 2* . . . ,  N) ,  X,  and  X^  wi^  at 

most  n+1  different  from  aero  such  that 

|l| 

UjXj+...+  U^x^+l  ■  X  X<<»>(u{<«>Xj+...+uJ^^^x^)  +  X(.UjXj . u^x^+1)  +  X^ 

q»l 

N  N 

or  U,  ■  X  X^^U^-  X(L . U  ■  X  Xu,,  1  «  X+  X,  . 

*  q«l  "  ^  *  q.l  •  ®  ® 


This  is  a  consequence  of  tte  inhomogeneous  case,  ^2. 

Therefore  every  solution  u^,  U2» ...» u^  of  tbm  systeo  of  inequalities 

D|^  >  0  (ksX)  can  be  put  in  Hbm  following  form 

N  ,_v  N 

X 

q«l 


“l  •  =  ’^'^'4’’+  ^*1  -  “2  •  '■?’  ♦  S“2 . 


u  .  X  X^*i W  +  X,u, 
®  q«l  "  ®  “ 


ehere  X^*^,  X^  i  0  , 


20“ 


This  follows  from  observixxg  that 


Uj+  Xuj 


r  and  Uj+  \uj=  U^+  Uj-  X^Uj  ,  etc. 

q=l 


The  converse  of  the  statement  is  also  true  simply  by  reversing  Ae  steps 
to  put  things  in  terms  of  U^t ...» again  and  appealing  to  Theorem  3. 


4.  Integral  Inequalities 

Let  aj^(x),a2(x), . . .  ta^(x)  and  a(x)  be  continuous  fvinctions  in  the 
interval  o  <x  <^.  Let  u(x)  range  over  all  continuous  functions  defined  in 
this  interval.  \7c  say  that  the  inequality 

P 

/  a^(x)u(x)dx>  0  is  tlie  consequence  of  the  following  ineqvialities 

P  P  P 

/  a,  (x)  u(x)  dx  >  0  ,  /  ^2^^^  dx  >  0  ,  .  .  .  /  a  (x)  u(x)  dx  >  0 

a  ”  a  ^  a*'  “ 

if  it  is  satisfied  by  all  continuous  u(x)  which  satisfy  the  above  system.  We 

assume  that  the  functions  a^(x)«  . . . » a^(x)  are  all  linearly  independent. 

XYe  then  assert: 

Theorem;  In  this  case  we  can  write  a(x)  in  the  following  form; 


a(x)  =  Xj^a^(x)  +  + . . ,  +  X^a^(x),  where  Xj,  X^f ....  X 


constants. 


Proof;  \7e  can  solve  for  X^,  X,* . . .  >  X^  from  the  following  system  of  linear 
equations : 

P  P  2  P  P 

/  A^{x)  a(x)  dx  =  X.  /  aj(x)  dx  +  ^2  dx  + . . .  +  X^  /  aj(x)  a^(x)  dx 

or  *  a  ot  Cl 

P  P  P  P 

X  a2(x)  a(x)  dx  =  Xj  /  a2(x)aj(x)dx  +  Xj  X  *2^*^  dx  + . . .  +  X^  X  ^ 

ala  a  a 

P  ’  P  P  P  2 

X  a^(x)a(x)dx  =  Xj  X  a^^Cx) aj(x)dx  +  X2  X  a^(x)a2(Jt)dx  +  ...+  X^  X  dx 
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The  matrix  of  this  system  is  positive  definite,  for  let 

P 

A  =  (apq)  =  (  /  ap(x)  a^(x)  dx )  be  the  linear:-  transformation. 

Then  we  have  to  show  (Ax|  x)  =  0  =*>  x  =  0  ,  But 

n  n  P 

(Ax|x)=  2  -f  ap(x)a^(x)dx  . 


p,qd  P  <1  P«  p,qd  P  ■>  « 


/  [  x.a,{x)  +  x,  a2(x)  +  . . ,  +  x^  a^(x)  1  ^  dx  . 


Hence  (Axjx)  a  0  iniplice  x^a^(x)  +  x-a-tx)  +  . , .  +  x  a^(x)  a  0  for  x<[a.p] 

=>  Xj  =  x^  =  •  e .  =  x^  =  0  since  ap(x)*8  are  linearly  ixulependent. 

But  this  means  A  is  non-singular;  for  if  Ax  =  0,  then  from  {(Ax,x)|<  |Ax(I  mi( 
we  have  that  (Ax,  x)  *  0  and  hence  x  =  0  . 

Hence  there  exists  a  unique  solution  X^,  \2, . . . ,  . 

Let  w(x)  -  a(x)  -  X^a^Cx)  -  -  ...  -  X^a^(x)  .  Then 


P  P  P 

/  aj(x)  v/(x)dx  =  0  ,  /  a2(x)v/(x)dx  =  0  ,  /  a^(x)v/{:^dx  =  0  . 

a  a  a 


Similarly  for  -v/(x).  Hence  as  a  consequence  we  have 

P  P 

/  a  (x)  w(x)  >  0  and  -  /  a(x)  v/(x)  >  0 
ct  a  ~ 

P 

==>  /  a(x)  w(x)  dx  =  0 .  Now  replace  a(x)  by  w(x)+Xjaj(x)  + . . .  +  X  a  (x) 

Of  V  V 

P  2 

/  v/(x)  dx  =  0  which  implies  w(x)  *  0  ,  i,  e. , 
a 


a(5a)  —  Xj^ a^(x)  X^ a^fx)  -^o . .  -i*  X^ a^(x)  . 


to  get 
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We  have  to  show  now  that  >  0  (i=l,  Z, , , .  ,v) 

Consider  the  system  of  equations: 

P  p  p  p 

/  a2(x)  aj(x)  dx  =  h>2  /  ^2^*^  dx  +  /  a^Cx)  a2(x)  dx  +  . . .  +  /  a.^(x)a.^(x)  dx 


P  P  P  P 

/  a3(x)aj(x)dx  -  y-2  S  a,(x)a2(x)  dx  +  n,  /a.(x)  dx+,..+  |Ji  /a,(x)a  (x)  dx 
a  a  a  a 


^  .  P  P  2  P  2 

/a^(x)aj^(x)dx  =  jjt^  /  r.^(x)  a^tx)  dx  +  |ji,  /  a.{x)  dx+. . .+  /  a  (x)  dx 

a  at  ^  a  ^  a 


Since  ai^(x).,  a.^{x) , . . .  ta^(x)  are  linearly  independent  we  see  that  the  matrix 
of  this  system  is  non-singular.  Hence  there  is  a  unique  solution  p,.  p,.  •  •  >  >  p  . 
Let  w  (x)  =  aj(x)  -  ^2^2^*^  “  -  ...  -  H^^,a^(x) 


so  that  we  can  write  the  above  equalities  in  the  form 

P  .  P  -  P  ^ 

/  a-Cx)  V/  (x)  dx  =  0  ,  /  a,(x)  w(x)  dx  =  0, . . . ,  /  a,(x)  w(x)  dx  =  0  . 
or  a  a 

P  -  P-2 

Furthermore  /  aj(x)  w  (x)  dx  =  /  v/(x)  dx  >  0  otherwise  a,{x)  v/ould  be 
or  a 


a  linear  combination  of  the  other  a^(x)*8  . 

Hence  v/(x)  is  a  solution  of  our  integral  inequalities  and  as  a  consequence 

P  . 

we  have  /  a(x)  vj(x)  dx  >  0  ,  But 
a 

P  -  P,  -  P  ? 

/  a(x)  w(x)dx  =  /  [\^aj^(x)  +  '*’•  *  dx  =  Xj  J  w(x)*  dx  >  0  . 

a  a 


Hence  >  0 .  Similarly  we  argue  for  . . . ,  by  removing  Uie  appropriate 
aj(x)  from  {a^(x),a2(x), . . .  ,a^(x)},  and  considering  the  smaller  system  of 
linear  equalities.  Hence  the  assertion  is  proved. 
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